A Pragmatic Study and Analysis of Load Balancing Techniques In Parallel Computing

Allocation of the work load in to small processes is known as Load Balancing .Parallel programming is based on four phases finding Concurrency (by understanding the available concurrency and expose in algorithm design), Algorithm structure (programmer develop high level structure for organizing parallel algorithm), Supporting structure (in this code analyzing techniques used to manage data), Implementation mechanism (final steps to look specific software construct for parallel program implementation).The middle two phases based on patterns. With availability of parallle programming models OpenMP(Shared Memory Model) MPI(Distributed Memory Model) ande Hybrid(OpemMP and MPI) there is various aspects while doing load balancing in High Performance Computing also there are typical load balancing approach, Static and Dynamic are broadly categories. For this review paper keeping vision on efficiency and speed we have discussed the aspect and issues associated with typical categorised load balancing techniques.